Autonomous Road Driving Arenas for Performance Evaluation

The development of performance metrics is critical in the evaluation and advancement of intelligent systems. Obtaining the pinnacle of intelligence in autonomous vehicles requires evolutionary standards and community support. In order to analyze and compare competing implementations of intelligent systems, the critical components of the system must be decoupled to facilitate repeatable trials that target specific aspects of the system’s overall task. This paper presents a framework for a real virtual simulation environment that provides the facilities and tools to formally test the limitations and capabilities of autonomous road driving vehicles.